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ABSTRACT 
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REMEMBER . . 



When we came to your school to talk to your teachers about the 
Local/State Bilingual Program? 



NOW . . . 

We are sending you this brochure to put some information we gave 
you verbally about evaluating the bilingual program in operation 
at your school. This will also give you more detail than ve <*ave 
you at that time. 



WHY DO WE EVALUATE ? 

Educators are being increasingly urged by citizens to account for 
taxpayers' money being spant on bilingual education. 

Parents have the right to know whether or not the bilingual program 
is beneficial to their children. 

Local school board officials want to know if monies appropriated 
' for • bilingual education are producing desired results* 

The Texas State legislature wants to know if State mandates for 
bilingual education are being met. 



WHAT SHOULD A TEACHER KNOW ABOUT BILINGUAL PROGRAM EVALUATION ? 

Program Objectives . The program teachers, (Title VII teachers) and 
staff have formulated what they consider minimum outcomes as the 
result of the efforts made by all concerned in delivering bilingual 
education services to identified students at the various schools. 

Evaluation Instruments . In order to measure the objectives, tests, 
surveys, questionnaires, ratings, and observations are used to 
gauher information relating to those objectives. These instruments 
are then administered and their results analyzed to determine the 
attainment or non-attainment of the program objectives. 

The program objectives and evaluation instruments for each grade 
level are listed in the following pages. 



Kindergarten 



COMPONENT 


YEAR-END OBJECTIVES 


EVALUATION PLAN 


Language Development 






First Language 


Project studencs will demon** 
strata an increase in oral 
language skills as measured by 
the Primary Acquisition of 
Language (PAL) score in their 
first language. 


i 

Significant gain from Fall 1 
1977 to Spring 1978 PAL 
Oral Language Dominance 
Measure scores for a sample 
of students. 


Second Language 


Project studencs will demon- 
strate an increase in oral 
language skills as measured by 
the PAL in their second langu- 
age. 


Significant gain from fall. 
1977 to spring, 1978 for a 
sample of students. 


Concept Development 






First Language 

I 
I 


A. Spanish-Uominant^tudents 
will demonstrate acquisition 
of Hath readiness 3kills 
through, instruction in 
Spanish. 

3. English-Dominant students 
will demonstrate acquisition! 
of Math readiness skills 
through instruction in 
English. 


a. 3oehm Test of Basic 
Concepts 

b, 3oehm Test of 3asic 
Concepts 


Second Language 


Concept development in the 
second language is confined to 
the Language Arts Program. 


As noted for Language 
Development above. 


Development of Self 
Concept 

i 

i 

i 

t 

! 


A. State bilingual staff tjiil 
observe displays or activi- 
ties indicative of bicul- 
turaJt activities o~\ at least 
*1 of their visits to class- 
rooms containing project 
students. 

3* Project students will demon- 
strate an increase in posi- 
tive feelings about them- 
selves, their culture and 
their home background. 


a. Tally of observation 
forms completed by State 
Bilingual Program staff 
after each classroom 
visit. 

b. Mo formal evaluation 
planned, due to lack 
of a suitable instru- 
ment; informal evalu- 
ation will be carried 
out by the program staff 



MOTE: First language is determined by the teacher, based on the ?AL* 
observations ana consul tatiqns with parents, staff or anyone in 
close contact with the child. 



First Grade 



COMPONENT 



YEAR-END OBJECTIVES 



Languag* Development 
First Language 



EVALUATION PLAN 



Second Language 



| Concept Development 



First Language 



Second Language 



| Development of Self 
Concept 



Project students whose first 
language is English will 
demonstrate development in 
English reading and vocabu- 
lary skills. 



B. Project students whose first 
language is Spanish will 
demonstrate development in 
Spanish language skills. 



A. Project students whose first 
language is English will 
demonstrate development ^in 
Spanish language skills. 

3. Project students whose first 
language is Spanish will 
demonstrate development in 
English language skills. 



A. Project students whose first 
language is English will 
demonstrate development of 
Concepts in English. 



Project students whose first 
language is Spanish will 
demonstrate development of 
Concepts in Spanish. 



Concept development in the se- 
cond language is confined to the 
Language Arts Program. 



At least 502 of the pro- 
ject students for whom 
English is the first lan- 
guage will score above 
the 60*ile on the CAT 
vocabulary and reading 
comprehension subtests 
on the April, 1978 test. 
Significant gain from 
fall, 1977 to spring, 
1978 Primary Acquisition 
of Language (PAL) test 
scores for a sample of 
students on Spanish 
subtest. 

Significant gain from 
fall, 1977 to spring, 
1978 on PAL Spanish sub- 
* test for a sample of 
students* 

Significant gain from 
fall, 1977 to spring, 
1978 on PAL Spanish suo- 
test for a saaple of 
students. 



I 



a. At least 50Z of the pro- 
ject students for wnom 
English is first language 
will score above the 50% 
ile of the CAT Math sub- 
test on the April 1978 
test. 

b. At least 50t of the pro- 
ject students whose first 
language is Spanish will 
score above 20 pts. on 
the Spanish Math Test 
(EME), given to a saaple 
of students. \ 

Significant ga^n from fall, 
1977 to spring, 1978 on PAL 
Spanish subtest for a sample 
of students. 



A. State bilingual staff will 
observe displays or activi- 
ties indicative of bicultural 
activities on at least * of 
their visits to classrooms 
containing project students. 

B. Project sttfdehts will demon- 
strate an increase in posi- 
tive feelings about them- 
selves, their culture and 
their home background. 



a. 



Tally of observation forms 
completed hy state bilin 
gual program staff after 
each classroom visit. 



Mo formal evaluation 
planned, due to lack of a 
suitable instrument; in- 
formal evaluation will be 
carried out by the program 
staff. 



NOTE: First language is determined by the teacher* based on the PAL, 
observations and consultations vith parents, 3ta£f or anyone in 
close contact with the child. 
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Second Grade through Fourth Grade 



COMPONENT 



YEAR-END OBJECTIVES 



EVALUATION ?LAU 



I Language Development 
; First Language 



Second Language 



I Concept Development 

i 

t 

[ First- Language 



Second Language 



Development of Self 
Concept 



Project students whose first 
language is English will 
demonstrate Improvement In 
their English reeding and 
vocabulary skills. 



Project students whose first 
language Is Spanish will 
demonstrate Improved skills 
in Spanish reading. 



Project students will demon- 
strate Improvement in their 
language development In their 
second language* 



Project students whose first 
language is English will 
demonstrate improvement in 
their English concept skills 



B. Project students whose first 
language is Spanish will 
demonstrate Improvement in 
Spanish concept skills. 



Concept development in the 
second language is confined to 
the Language Arts Program. 



State Bilingual staff will 
observe displays or activi- 
ties indicative of blcul- 
ture activities on at least 
4 of their visits to class- 
rooms containing project 
students. 

Project students will demon- 
strate an increase In posi- 
tive feelings about them- 
selves, their culture and 
their home background. 



a. -Significant gain from 
fall, 1977 to spring, 
1978 and the reading & 
vocabulary subtests of 
the CAT for a sample of 
students for whom Eng- 
lish is the 'first lan- 
guage. 

b. Significant gain from 
fall, 1977 to spring, 
1978 on the Prueba de 
Lecture, Level I for 
a sample of students. 

Teachers will rate at least 
75X of a sample of students 
as having improved their 
skills in their second lan- 
guage. 



Significant gain from 
fall, 1977 to spring, 
1978 on the math sub- 
test of the CAT for a 
sample of students tor 
whom English is the 
first language. 
Significant gains from 
fall, 1977 to spring, 
1973 for a sample of 
students on the Spanish 
Math Test. 



As noted for language 
Development above. 



b. 



Tally of observation j 
forms completed by State 
3111ngual program staff i 
after each classroom j 
visit. 



No formal evaluation 
planned, due to lack of 
a suitable instrument; 
informal evaluation will 
be carried out by the 
program staff. 



NOTE: First language is determined by the teacher, based on the PAL, 
observations and consultations with parents, scarf or anyone in 
close contact with the child. 



TERMS. 



Te-ms used in our evaluation process or testing which may need defining 
are as follows: 

1. First Language . Whichever language for which the Primary Acquisition 
of Languages (PAL) test score is higher determines "first" language. 
The exception being those students who are considered bilingual (both 
scores over 85), for these' students, English is considered the first 
language. Therefore, second language is the language in which the 
student makes. the lower score. 

2. Significant gain . A statistical term used to express the degree^ of con- 
fidence that the differences found among scores are true differences 
and not chance differences. The Office of Research aftd Evaluation uses 
the .05 level of significance which means that only 5 times out of 100 
would the scores reported differ as much as they do just by chance. 

3- Oral Language Dominance Measure (PAL) . The PAL was designed to provide 
an easy instrument to administer for measuring language dominance in 
both English and Spanish. It is especially appropriate for kindergarten 
and first grade students; and it is particularly useful as a placement 
test in bilingual programs. The PAL has 29 itciros to which th^ student 
responds verbally. 

4. California Achievement Test (CAT) . The CAT is a standardized achieve- 
ment test battery with norms. Two tests are administered, mathematics 
and reading. The math test also has two subtest: Computation and 
Concepts and Problems. The reading test has two subtest: Vocabulary 
and Comprehension. It is given once a year by the classroom teacher. 

5. The Boehm Test of Basic Concepts , This consists of fifty items arranged 
in order of difficulty. Each item consists of a set of pictures with 
statements read to the child. These statements brief 1 'escribe the 
pictures and ask the child to mark the one illustrating the concept area. 
The test is given twice within a year and is given by the teachers in 
their own classrooms. 

6. The Spanish Math Test (El Examen de Matenuatica en Espanol) . Level A 
consists of 52 teat items and three practice problems. All items are 
multiple choice. The test is administered by the Office of Research 
and Evaluation Staff and is given to 1> 2, 3, and 4 graders. It is 
used to measure the ability to comprehend and do math in Spanish. 

7. Spanish Reading Test (Prueba de Lectura) , This test consists of forty 
test items that test the level of comprehension, and forty items that 
test the level of vocabulary. The test is administered bianually and ^ 
is given by ORE Staff. The main purpose of the test is to find a childs 
level of reading ability in Spanish. 



WHAT HAPPENS AFTER THE TESTS' ARE GIVEN? ARE THE SCORES SENT TO 
THE TEACHERS? 

After the tests are given, they are scored by the Office of 
Research and Evaluation. The only test scores which are sent 
to the teachers by ORE are the Oral Language Dominance Measure 
(PAL) arid the Examen de Matem/tica en Espanol. The scores for 
the PAL go out to the teachers sometime in October and those 
for the Examen de Matematica go out after the posttest and as 
soon as the scores have been analyzed. The scores for the 
Prueba de Lectura are used by ORE for assessing the level of 
reading in Spanish; but are not sent to tha schools. The 
California Achievement Test and the Boehm Test of Basic Con- 
cepts are sent to the schools by the District since both these 
tests are a District-wide project. 




Tests, tests and more :ests. 
I wish there were a simpler 
way to do all these 

evaluations? 



